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ABSTRACT 
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and word order) and phonological features in English. The test 
consists of 43 items which refer to three pictures. The group score' 
indicates which features of the language are most troublesome for a 
particular group of students. The conceptual oral language test 
(COLT) is used with pupils in the primary block who are low achievers 
because of inadequate control of standard English. The COLT is 
designed to assess the pupil's ability to solve problems and talk 
about basic concepts in mathematics, science, and social sciences. 
This test consists of 60 items divided into four formats: 
differentiation, classification, seriation, and analogy. Test 
administration requires approximately 35 minutes. Assessment of 
instructional programs for bilingual and non-standard English 
speakers is facilitated through the evaluation of the results of this 
test. (RL) 
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Preface to the ACTFL Edition 



Since its organization the American Council on the Teaching of Foreign Languages 
(ACTFL) has been interested in and concerned with the education of Americans for 
whom English is not the mother tongue. This interest and concern have led ACTFL 
to study several instructional programs in this area. 

One set of materials which came to our attention is the Michigan Oral Language 
Series produced under the direction of Ralph Robinett and Richard Benjamin with 
E.S.E.A. Title I-Migrant funds provided by the Michigan Department of Education 
to the Washtenaw County Intermediate School District and the Foreign Language 
Innovative Curricula Studies (E.S.E.A. Title III). The series consists of struc- 
tured oral language lessons for use with four, five and six year old children who 
need to learn English as a second language or standard English as a second dialect 
the lessons are accompanied by evaluation and teacher training materials. 

The series gives the teacher a detailed sequence of oral language activities which 
are not only linguistically controlled but also emphasize and reinforce the 
conceptual development of the child. 

ACTFL has made these materials available for several reasons: 

1. So that you can see what one project has been able to produce with competent 
staff. 

2. So that you will appreciate — if you do not already — what materials development 
means. 

3. So that you can use these materials for training personnel in your institution. 

4. So that you may consider adapting or adopting them — in whole or in part — for 
your program. 

The series consists of six components: 

1. Bilingual Conceptual Development Guide — Preschool 

2. English Guide — Kindergarten 

3. Spanish Guide — Kindergarten 

4. Interdisciplinary Oral Language Guide — Primary One 

5. Michigan Oral Language Productive Tests 

6. Developing Language Curricula: Programed Exercises for Teachers 

If you wish to order multiple or single copies of these texts please consult the 
catalogue published by ACTFL. 

This ACTFL Project has been made possible by CONPASS (Consortium of Professional 
Associations for Study of Special Teacher Improvement Programs) , under a grant 
from the U.S. Office of Education, and it is intended to extend the work of CONPASS 
initiated at its conference in Grove Park, North Carolina on 10—15 June 1969. ACTFL 
extends its appreciation to CONPASS for the grant which makes the distribution of 
these materials possible and to the staff of FLICS and the Migrant Worker Program 
for their willingness to share the fruits of their work. 



F. Andre Paquette 
Executive Secretary 



3 






MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST 
Conceptual Oral Language Test 



Research and Design 
John C. Larson 



Development Staff 

Dustin L. Decker 
Marilyn M. Larson 



Ralph F. Rob 1 nett 
Director 



Richard C. Benjamin 
Associate Director 



These materials were developed by the Washtenaw Intermediate 
School District under a grant from the Migrant Program of the 
Michigan Depa rtmen t of Education and are the property of the 

State of Michigan 

1969 

MICHIGAN MIGRANT PRIMRY INTERDISCIPLINARY PROJECT 
3800 Packard Road* Ann Arbor* Michigan* 48104 Ph. (313) 971-5313 



MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST 
Structured Response 



REVISION STAFF 

Richard C. Benjamin 
Evaluation 01 rector 



Ralph F. Rob 1 nett 
Consulting Editor 



Revision Writers 



Helen Carney 
Barbara Stovall 



Field Examiners 



Beth Berghoff 
Sherron Dean 
Eleanor McCrtmfc 
Alex Rose 
Barbara Stovall 



Diane Confortl 
Dan Hallahan 
Regina Richards 
Lucy Smeltzer 
Linda Van Qyke 



This test Is based on the Dade County Test of Language 
Development. The original test has been revised and 
enlarged In cooperation with the Foreign Language In- 
novative Curricula Studies with permission of the Divi- 
sion of Research* Development* and Evaluation* Dade 
County Board of Public Instruction, Miami* Florida. 
Inquiries should be addressed to Evaluation Director* 
Michigan Migrant Primary Interdisciplinary Project* 

3800 Packard Road* Ann Arbor* Michigan 48104. 



MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 

Directions for Administration 



I. OBJECTIVE 

The purpose of the test is to assess the child's ability 
to produce standard grammatical and phonological features 
when he speaks. 

II. METHOD 



A. Standard Stimulus . The child is shown three pictures 
which form a story. He is given a Stimulus (S) concerning one 
of the pictures. The Stimulus is structured so that the child 
will give a Response (R) containing a particular feature of gram- 
mar or pronunciation. 

the procedure for giving the Stimulus (S) and scoring the 
Response (R) is as follows: 

1. Give Stimulus, marked S 

2. If Child does answer with underlined Response (R^ 

record response number. 

3. Give (S) second time if child gives no answer 
the first time. 

4. Do not give any further help. 

5. If child gives an answer which is not listed in 
the test, or if he doesn't respond after the second 
time, mark 0 (other) 

B. Importance of Standard Stimulus . It is important to 
g i ve the Stimulus (S) as it Is written . 

For example: (Question 5 - Stimulus) 

PAST PARTICIPLE 

S (Point to boy) (Child's name). 

Ask the boy If he 
always goes to this 
river to fish. 

Have you always . . . 

As may be seen, if the examiner did not Include the words. 
Have you always , the child could say. Do you always go . 
Instead of Have you always gone . It would then become 
difficult to find out what word the child uses for gone 
without actually giving him a cue or answer. 

C. Use of Tape Recorder . To help the teacher check on 
whether or not he has given a standard Stimulus, it is 
convenient to use a tape recorder during the testing sessions 
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Later on, when playing back the tape, the teacher may not only 
check on the standard Stimulus, but also recall various features 
from an individual child's test. The children will not be 
afraid of the recorder if they are allowed to hear themselves on 
the recorder a little bit before the test. 

The tape recorder need not be used extensively to score 
the test, however. Examiners have found that on-the-spot scor- 
ing is not only more practical but equally or more reliable for 
checking sound differences that are important in the phonologi- 
cal and grammatical features tested. 

in. GENERAL TEST CONSIDERATIONS 

A. Time Required . The 43 items should take approximately 
15 munutes to give. 

B. Testing Room and Equipment . No extra equipment is 
needed besides the test booklet with its three pictures. You 
will need to reproduce five more response sheets. A tape recorder 

is advisable for the first few children as a means of self- 
checks. 



C. Setting the Child at Ease . The teacher Is at an 
advantage in the testing situation because the child already 
knows her. Working with the tape recorder may be strange for 
the child, and the test may be different from any he has 
encountered before. However, the tape recorder will help the 
teacher get the child to name his brothers and sisters, tell 
about a pet, tell about something he did well yesterday in 
class; or, if the child does not seem to be afraid, he may 
wish to tell about the things he sees in the first picture 

he is shown. 

Sometimes the children are quite verbal, and sometimes 
they need help in this warm-up period. If the child does not 
respond to the questions above easily, it is best just to go 
right into the test. The praise given for answering will 
begin to make him feel at ease. 

D. Praise for Answering . The child feels more relaxed 
and will try to give better answers if he is praised. Even 
if he misses giving the grammatical or phonological feature 
needed, praise may be given. However, the child is sensitive 
to false praise. It is better to give moderately positive 
comments such as, f i ne , or You're giving me lots of answers. 

or even an enthusiast! c uh-huh or O.K. Often words like* good 
and very good * begin to sound false. Also, testers sometimes 
find themselves saying, good , when the answer is standard and 
a dull uh-huh , when the answer is non-standard. Moderately 
positive comments will guard him from this tehdency. 
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IV. SPECIFIC TEST CONSIDERATIONS 

There are many questions the teacher will have as she 
begins to test. The most common are listed below: 

1. Uhat is the best way to give the Stimulus? 

The Stimulus must always be read word for word. Sometimes 
you will find a line of dashes drawn over to a part of the 
Stimulus. It is helpful for the child to repeat the 
Stimulus from this part throu^i to the end. 

For example: (Question 34 - Stimulus) 

USES OF BE 



S Let's name some things 

in this picture. 

(Pointing) These are dishes. 

(Point to table) These are chairs, and 

(If necessary, help 

child repeat) This ... 

If the child repeats this, it gives him a good start at 
producing the whole sentence. Otherwise, he may give 
a short answer, a table. The verb to be tested will be 
missed. 



2. How do you get a child to repeat the last word? 



After the teacher becomes somewhat familiar with the test, she 
will be able to use eye contact to have the child repeat what 
she says. The child will become used to the teacher looking 
up from the picture and will realize he is to repeat words. 



This eye contact system has the advantage of being non-verbal , 
so the child can concentrate only on the question. Until the 
system Is established, the teacher may need to deviate from 
the general Instructions in the following way: 

a. Read the entity Stimulus; 

b. Tell the child. Say what I say, (child's name) . 

c. Repeat just the starting word of the child's sentence. 

d. Repeat the entire Stimulus with the child's starting 
word given twice. 

For example: Teacher: Did the father start to 

fish by himself, or did 
he wait for the boy? 

He ... 

Teacher: Say what I say, (child's name). 



Teacher: He . . . 



ERIC 
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If necessary* 

Teacher: Did the father start to 
fish by himself, or did 
he wait for the hoy? 

He ... 

ri3 ... 



3. What if a child remains silent? 

If a child remains silent on a particular question* it may 
be that he doesn't know the meaning of one of the words. 
This has been anticipated to a great extent in the test. 
Changes have been made to use simpler words, or definitions 
have been provided. In any case, it is a good policy when 
the child is silent to ask: 

Teacher: Do you know what ( ) means? 

It means (simple synonym). 

(Repeat Stimulus) 

Even if the child says he knows what a word means, it is 
good to give the synonym. 

Sometimes the child doesn't understand what the teacher Is 
pointing to in the picture. However, If the teacher tries 
to give some verbal explanation, she may run the risk of 
giving the child the answer. Therefore, If the child does 
not seem to understand what the teacher Is pointing to, 
the teacher may say: 

Teacher: Point to the same thing I'm pointing to. 
(Guide child's finger to same point) 

(Repect Stimulus) 



4. What if a child generally does not give answers? 

It is easy to assume that if a child does not give answers, 
he doesn't understand. It is just as easy to asstmie some 
erroneous causes. Tfie teacher Is at a distinct advantage 
in this testing situation. If a particular child does not 
_ give answers, the teadver may want to re-test him after she 
has tested several other children. Quickly reviewing the 
information she has accumulated with these children, she 
may pick out the simplest questions. Starting with these, 
the child will probably begin to answer questions. 
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5. Is it necessary to test exactly five students several 
tines a year? 

There is no magic about the number five. In other 
words, it is not a necessary number; it is only a 
convenient nunber. Me would like to stress * however, 
that the value of the Structured Response test is 
it's ability to give the teacher a quick overview of 
her students' language needs. The more efficient 
the curriculum is in meeting the students' language 
needs, the more quickly the overview is likely to 
change. To ease the teacher's load, we recommend 
that she test five pupils taken at randon every six 
weeks or so. She can easily spevuT fifteen minutes 
with one pupil each day for a week. 



6. What will the scoring system tell me? 

The Structured Response test has eleven grammatical 
and phonological categories. After the teacher has 
tested five pupils, for example, she need spend only 
15-20 minutes to arrive at the Category Percentages 
for the eleven categories. You will notice that 
the Category Sheet helps you keep record of the 
percentages for six testing dates. This record can 
show you if the curriculum's progress is meeting 
the students' language needs. 
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MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 



Directions for Admini strati on Example ( I tew 1 below) 

a. Give Stimulus* marked S. S Let's name some things* 

(child's name). 

This Is a boy. This Is 
the father* and these ... 



b. As you read, point to Stimulus 
objects in picture. 

e.g., Point to boy wlien saying This is a boy 

Point to father when saying This is the father. 

Point to trees when saying and these ... 



c. If child answers with an underlined 
Response, marked R, 

-Record response number on Response 
Sheet, e.g., (1) ... are trees 


See section (R) In I tea 1 below 
Recorded as: (1) 


d. Response number is determined only 
by underlined portion; 


Recorded as: (5) 


e.g., ... is trees 


e.g., ... Is. tadpoles 


Recorded as : (5) 



e. If child doesn't answer, or doesn't use 

an underlined Response, , „ _ , . , 

-Repeat Stimulus See section (S) In Item 1 below 

-having child join in with 
you from the dashes; 
e.g., (If necessary* 

have child repeat) This Is a boy. This Is 

the father, and these ... 



f. After second time, if child still doesn't 
answer, or doesn't use an underlined 

Response, , % 

-Record (0) Recorded as: (0) Other 

-Go on to next item 



g. Accept final response; 

e.g.. If child says, ... are trees 

and then says, ... is trees Recorded as: (5) 



Example (Item 1) 

5 Let's name some things, 

(child's name). 

(Point to objects) 

(If necessary, 

have child repeat) This Is a boy. 

This is the father, 
and these ... 



R (1) ... are trees. 

... Is trees. 

... be trees. 

... trees, ( verb 

ftted) 



(Points to trees) 



(0) Other 
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Test I tens 



1. lists OF tiE 

(Are as Min verb) 



[ ERIC 
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Let's name some things, 
(child's name). 



(Point to objects) 
(If necessary, 
help child repeat)* 



(Point to trees) 



This is a boy. 

This is the father, 
and these ... 



R (1) 



are trees. 



(5) 

( 6 ) 
(7) 
( 0 ) 



... iis trees. 
... be trees. 
... trees. 
Other 



(verb omi tted) 



2. PLURAL 

(Regular - /z/ ending) 



S (Point to trees) 



Let's count these, (child's name) 
One, two, ... 

Three what? 



Trees^. 


(s_ pronounced /z/) 


Trees. 


(£ pronounced /s/) 


Treetl). 


(/z/ omitted) 


Treezez. 


(non-standard plural) 


Other 





Use Picture 1 
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3. DOUBLE NEGATIVE 

(Negated main verb plus affirmative noun determiner or noun sdbsititute 
doesn't have plus a, one , or any) 

S (Pointing) The father has a fishing pole, but 

the boy doesn't have ... 



R (1) ... * fishing pole. 

(2) ... one. 

(3) ... any fishing pole. 

(4) ... any. 



(5) ... no fishing pole. 

(6) ... none. 

(0) Other 



4. USES OF HAVE 

( Have as auxiliary; requires following past participle, walked) 

S (Point to boy) (Child's name) 

Ask the boy if he has walked 
along the river before. 



R (1) Have you walked along the river before? 

(5) Has you walked along the river before? 

(6) Has you wa1k( ) along the river before? 

(7) Have you waTk( ) along the river before? 

(8) Did you walk along the river before? 

(9) Did you wal ked along the river before? 

(10) l£ you walk along the river before? 

(11) Is you walked along the river before? 

(12) You vialk along the river before? ( have and -ed omitted) 

(13) You walked along the river before? ( have omitted) 

(0) Other 




Use Picture 1 



• • 
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5. PAST PAftTIcIPlE , , , 

(Irregular - past participle* gone * not the same as Infinitive plus 

/d/ l.e. , oped, nor as the past, went) 



R (1) ... gone to this river to fish? 

(5) ... went to this river to fish? 

(6) ... go to this river to fish? 

(7) ... goes to this river to fish? 

(8) ... goed to this river to fish? 

(0) Other 



6. PRONUHCIAftON 

(Initial consonant sound th pronounced as In thin, think) 

S (Holding thtmfc up) What do you call this? A ... 



R (1) thuiifc. 



S (Point to boy) 



(Child's name) 



(Say with child) 



Ask the boy if he always goes 
to this river to fish. 

Have you always ... 




(0) Other 




7. PRONUNCIATION 

(Initial consonant cluster f 



k/ pronounced) 



S (Point to ground) 
(Point to sky) 



Me color grass green. 

felhat do we color blue? The ... 




/s/ omitted from /sk/) 
vowel added) 



ERIC 



Use Picture 1 
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8. USES Of DO 

(In questions, main verb, likes , changes to like with addition of 
does auxiliary) 

S (Pointing to self) (Child's name) 

Ask me if the boy likes to fish. 



R (1) Pees the boy like to fish? 

(5) Do the boy like to fish? 

(6) Does the boy likes to fish? 

(7) Do the boy likes to fish? 

(8) The boy likes to fish? ( does omitted) 

(9) The boy like to fish? ( does omitted) 

(0) Other 



9. PASt PARTICIPLE 

{irregular - past participle, made, not the same as infinitive plus 
/t/, i.e., makt but is the same as irregular past) 

S (Point to the boy) Ask the boy if he always makes 

his own fishing pole. 

(If necessary, help 

child repeat) Have you always ... 



R (1) ... made your own fishing pole? 

(5) ... make your own fishing pole? 

(6) ... makes your own fishing pole? 

(7) ... makt your own fishing pole? 

(0) Other 

NOTE: Child may confuse pronouns. Do not score his pronoun use. 
Score only the underlined form of past participle. 




Use Picture 1 
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10. PRONUNCIATION 

(Final consonant in the cluster /st/ pronounced) 

S (Make slow swimming motion 
with hand, then make fast 

swimming motion) Some fish swim very slow, and 

some fish swim very ••• 



R (1) ... fast. 

(5) ... fas(J. (/t/ omitted from /st/) 

CO) Other 
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PAST TENSE 

(Regular - ftf ending) 



(Point to fish) 

(If necessary help 
child repeat)- - - 



Where did the fish juRp? 



•The fish ... 



( 1 ) 



jumped in the river. 



12 . 



( 5 ) 

( 6 ) 
( 0 ) 



... jump(_) in the river. 
... jump-ed in the river. 
Other 



(/t/ omitted) 
(2 syllables) 



»ES OF m 

Jfrn't as auxiliary or as substitute for longer predicate; main verb, 
hcye > remains the same with addition of don't auxiliary; placement of 
not between auxiliary and main verb) 



S (Holding uo pencil or pen) 



(If necessary* help 
child repeat) 



I have a pencil (pen) in nor hand. 
Tell me if you have a pencil (pen) 
in your hand. 



•No, I 



( 1 ) 



don't ( do not) 'have a pencil). 



(5) 

( 6 ) 

(7) 

( 8 ) 
( 9 ) 



( 0 ) 



... doesn't ( doesnot) ( have a pencil). 

. . . don't U o not) has a penci 1 . 

. . . has a pencil . ( don't omi tted) 

... have a pencil. ( don't omitted) 

Any answer where not ( no) *:s placed before verb construction; 
e.g^, "... not (noTTave a pencil." 

Other 



Use Picture 1 
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13. POSSESSIVE 

(Regular - ^ pronounced /z/) 

S (Point to father's pole) Whose pole is this? This is the ... 



R (1) ... father's (pole). 



pronounced /z/) 



(5) ... father's (pole). 

(6) ... fatherT~ ) (pole). 

(7) ... pole of the father. 
(0) Other 



('s pronounced /s/) 

(/z/ omitted) 
(non-standard possessive) 



NOTE: Dad's , Daddy's and man's may be substituted for father's. 



14. 

S 

R 



COMPARISON 

(Superlative) 

(If necessary, help 
child repeat) 


(i) 


... most fun. 


(2) 


• • • b6S^« 


(5) 


... fun. 


(6) 


... more fun. 


(7) 


... funner. 


(8) 


... more funner. 


(9) 


... funnest. 


(10) 


... most funnest. 


(ID 


Any antonym of fun, 
harder, not fun. 


(0) 


Other 



The boy thinks T. V. is fun; 
baseball's more fun, and fishing 
the ... 



is 



(positive) 

(comparative) 

(non-standard comparative) 
(non-standard comparative) 
(non-standard superlative) 
(non-standard superlative) 




Use Picture 1 
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15. USES OF HAVE 

{ Has as main verb) 



S (Point to father's 

fishing pole) What does the father have in his hand? 

(If necessary, help 

child repeat) He ... 



R (1) ... has a fishing pole (in his hand). 

(5) ... have a fishing pole (in his hand). 

(6) ... haf a fishing pole (in his hand). 

(7) ... hab a fishing pole (in his hand). 

(8) ... has a fishing pole (in his hand). (^pronounced /s /) 

(o) Other 



16. PAST TENSE 

(Regular -/Id/ ending) 



S Did the father need some string, 

or did the boy need some string? 

(If necessary, help 

child repeat) The «. . 



R (1) ... (boy, father) needed some string. 

(5) ... (boy, father) needet some string. (/it/ substituted for /Id/) 

(6) ... (boy, father) need(_J some string. (/id/ ending omitted) 

(o) Other 



17. SUBJECT-VERB AGREEMENT 
(/s/ ending on verb) 

S Does the father go home, or 

does he keep on waiting? 

(If necessary, help 

child repeat) He ... 



R (1) ... keeps, on waiting. (s. pronounced /s/) 

(5) ... fceep(_) on waiting. (/$/ omitted) 

(o) Other 

NOTE: If child says. He goes home, reply. But, the father's still there. 

Then repeat the question. 



Use Picture 1 
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18. USbS OF HAVE" 

(Had as main verb) 

S (Child's name) What did you have 

for lunch yesterday? 

(If necessary, help 

child repeat) -I ... 



(1) 


. . . had etc. 


(5) 


... have etc 


(e) 


... has etc. 


(7) 


... hab etc. 


(8) 


. . . haf etc. 


(9) 


. . . hat etc. 


(0) 


Other 



19. PLURAL 

(Regular - /s/ ending) 



S (Point to rocks, one at 
a time) 



This is a rock. This is a rock, and 
this is another rock. So, there are 
three ... 



R (1) ... rocks. 

(5) ... rock(_). 

(6) ... rock-ez. 

(7) ... rock-es. 

(8) ..« rock-sez. 

(9) ... rock-ses. 
(0) Other 



(s pronounced /s/) 

(/s/ omitted) 

( ez pronounced /lz/) 
( es pronounced /Is/) 
( sez pronounced /slz/) 
(ses pronounced /sis/) 



20. PRONUNCIATION 

(Final consonant sound th_ pronounced as in bath or as in bathe) 

S Is the boy fishing by himself? 

No, he's fishing ... 



R (1) ... with his father. 

(5) ... wit his father. 

(6) ... wid his father. 

(7) ... wijhis father. 

(8) ... wis. his father. 

(0) Other 



(/t/ substituted for thj 
(/ d/ substituted for th) 
(/f/ substituted for th) 
(/s/ substituted for th) 




Use Picture 1 
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CHANGE TO PICTURE 2 



21. USES OF DO 

( Doesn't is auxiliary or as substitute for longer predicate; 
main verb, wears , changes to wear with addition of doesn't 
auxiliary; placement of not between auxiliary and main verb) 

S (Point to father's shoes) The father wears shoes in this picture. 

Tell me if the boy wears shoes. 

(If necessary, help 

child repeat) No, he ... 



R (1) ... doesn't ( does not) ( wear shoes). 

(5) ... don't ( do not) (wear shoes). 

(6) ... doesn't ( does notTwears shoes. 

(7) . .. don tTdo not) wears shoes. 

(8) ... wear shoes. 

(9) ... wears shoes. 

(0) Other 



doesn't omitted) 
doesn't omitted) 



22, COMPARISON 
(Superlative) 

S (Point to each fish 

starting with the smallest, 
on the left) 



R (1) ... longest (one). 

(2) ... longest ) (one). 

(5) ... long (one). 

(6) ... longer (one). 

(7) ... more long (one). 

(8) ... more longer (one). 

(91 ... most longT one). 

(10) ... most longest (one). 

(11) Any antonym of long , in any 
not long . 

(0) Other 



Here are four fish. This fish is 
short; this one is long. This one 
one is longer; and this fish is the 
very ••• 



(positive) 

(comparative) 

(non-standard comparative) 
(non-standard comparative) 
(non-standard superlative) 
(non-standard superlative) 
; e.g., short , shorter. 




Use Picture 2 
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23. PLJRAL 

TIi regular) 

S (Point to boy's feet) Here's a foot. And here's a foot. So 

there are two ... 

R (1) ... feet. 

(5) ... foots. 

(6) ... feets. 

(7) ... foot. 

(0) Other 

NOTE: If a child does not use some form of the word feet, sav, 

(showing hands) These are my hands, and (showing feet) 

These are my ... 



24. POSSESSIVE 

(Regular -'j_ pronounced /iz/) 

S (Point to fish's tall) Whose tall Is this? This Is the ... 



R (1) ... fish's (tail). 

(5) ... fish's (tail). 

6) ... fish“Q (tail). 

7) ... tail of the fish 
(0) Other 



(•s pronounced /lz/) 

Os pronounced /is/) 

(7iz/ ending oarf tted) 

. (non-standard possessive) 



NOTE: Do not score pronunciation problem, Ish . Score only 
the underlined form of the possessive. 



25. SUB JECT - VERB AGREEMENT 
(/Iz/ ending on verb) 

S Does the boy use big worms or 

little worms to get the fish? 

(If necessary, help 

child repeat) He ... 



(1) 


... uses (big, little) worms. 


(es pronounced /iz/) 


(5) 


... uses (big, little; worms. 


(es pronounced /is/) 


(6) 


... usiTJ. 


(plural ending omitted) 


(0) 


Other 





Use Picture 2 
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26. COMPARISON 
(Comparative) 

S (Pointing to boy) The boy Is little, but the 

(Point to smallest fish) fish Is nuch ... 



(1) 


... llttler. 




(5) 


... little. 


(positive) 


6 


... more little. 


(non-standard comparative) 


(7) 


... more llttler. 


(non-standard comparative) 


(8) 


... Tfttlest. 


(superlative) 


(9) 

(10) 


much. 


(adjective omitted) 


Any antonym of little, 
not little. 


in any form; e.q. , big, bigger 


(0) 


Other 





NOTE: Smaller (small, smallest) may be substituted for llttler 
ruttTe.Trttrestr — 



27. USES Of HAVE 

( Have as auxiliary; requires following past participle, fished) 

S Ask the boy If he has ever 

fished before. 



R (1) Have you ever fished before? 




Has you ever fished before? 
Ras you ever fish( ) before? 
Have you ever fishi ) before? 
Did you ever fish before? 

Dfd you ever fished before? 
ts you ever fish before? 

Tsf you ever fished before? 
You ever f1sh( ) before? 

You ever fished before? 

Other 



( have and -ed omitted) 
(have omitted) 



o 



Use Picture 2 
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28. P&T PARTICIPLE 

(Irregular - past participle, seen , not the same as infinitive plus 
/d/, i.e. , seed , nor as the pbt, saw) 



S 



(If necessary, help 
child repeat) 



Ask the boy if he always sees a lot 
of fish in the river. 

Have you always . . . 



R (1) ... seen a lot of fish (in the river)? 

(5) ... saw a lot of fish (in the river)? 

(6) ... see a lot of fish (in the river)? 

(7) ... sees a lot of fish (in the river)? 

(8) ... seed a lot of fish (in the river)? 
(0) Other 



29. PAST TEHSE 

(Regular - /d / ending) 



S (Point to boy's mouth) Did the boy cty a lot 

, or did he smile a lot? 

(If necessary, help 

child repeat) He... 



R (1) ... smiled (a lot). 



(5) ... smilt (a lot). 

(6) ... srnileQ (a lot). 

(7) ... smil-ed (a lot). 

(8) ... smil-ef (a lot), 
(o) Other 



/t/ substituted for /d/) 
/d/ omitted) 





Use Picture 2 
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30. DOUBLE NEGATIVE 

(Negated main verb plus affirmative noun determiner or now substitute: 
aren't plus any , or (_) birds) 

S (Point to the sky) There are no birds in the sky. 

So we can say that there aren't ... 



R (1) ... any. 

u) ... any birds. 

(3) ... birds. 

(5) ... no birds. 

(6) ... none. 

(O) Other 



31. PRONUNCIATION 

(Consonant sound n£ pronounced) 

S (Point to fish) Fish swim with fins. 

What do birds fly with? 



R (1) Wings. 

(2) (ATwin£. 

(3) (A) wink(J. 

(4) Wing-ez (-es). 

(5) WiiK '/n/ substituted for ng) 

(6) Wins. (/n/ substituted for ng) 

(0) Other 

NOTE: Child may have difficulty with /z/ pluralization. Oo not 

score pluralization problem. Score only the underlined pronunciation 
problem. 

If the child answers, feathers , ask, (Holding arms out to simulate 
w “* n 9s) What are the feathers on? Or, ask, (Holding arms out) 

What do airplanes fly with? 







Use Picture 2 




CHANGE TO PICTURE 3 
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32. PAST TENSE 

(irregular - past, went, not the same as infinitive plus /d/, 
i.e. , goed) 

S When the father and boy finished 

fishing, where did they go? 

(If necessavy, help 

child repeat)- They ... 



R (1) ... went home. 

(5) ... go home. 

(6) ... goed home. 

(7) ... go-ed home. (2 syllables) 

(0) Other 



33. USES OF BE 

( Mere as main verb or as substitute for longer predicate) 



S (Point to father and boy) Who was tired? 

(If necessavy, help 

child repeat) They both ... 



R 



(1) 


... were (tired). 




... was (tired). 


(6) 


... TT~( tired). 


(7) 


... are (tired). 


(8) 


... be (tired). 


(9) 


... tfred. 


< 18 ! 


They. 

Other 



( verb omitted) 
(verb omitted) 



34. U$ES Of BE 

(Is. as main verb) 



S 



(Point to each object) Let's name some things in this 

picture. These are dishes. 
These are chairs, and 

(If necessavy, help 

child repeat) this ... 



R (1) ... is (a table). 

(5) ... are (a table). 

(6) ... be (a table). 

(7) ... a (table). ( verb omitted) 

(0) Other 



Use Picture 3 
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35. PLURAL 

I Regular - /lz/ ending) 



S (Point to glass) 
(Point to glass) 


This is <i glass. 
This is a glass. 
That makes two ... 


R (1) ... glasses. 


(es pronounced /lz/) 


(6) ... glasses. 
(6) ... glass'll), 
(o) Other 


(es pronounced /Is/) 
(plural ending omitted) 



36. pROhUjCIATIOH 

(initial ch sound pronounced} 

S (Point to chair) What's the mother sitting in? A ... 

R (1) ... chair. 

(5) ... shair. ( S h substituted for ch) 

(0) Other — 



37. 



(Regular - 's pronounced /s/) 



S (Point to girl) 
(Point to blouse) 



Let's call the girl Janet. Whose 
blouse is this? This is ... 



R (1) ... Janet's^ (blouse). 

(5) ... Janet (_) (blouse). (/s/ omitted) 

(6) ... the blouse of Janet. (non-standard possessive) 

(0) Other 




Use Picture 3 
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38. USfcSOf BE 

( Isn’t as~wa1n verb or as substitute for longer predicate; requires 
following present participle, wearing ; placement of not between 
auxiliary and main verb) 

$ (Point to father and boy) The father and boy are wearing shirts, 

(Point to girl) but 

(Shake head "No") the girl ... 



R (1) ... Isn’t ( is not) ( weari ng a shirt). 

(5) ... aren’t ( are not) (wearing a shirt). 

(6) ... ain*t (w earing a shirt)/ 

! 7) ... not ( no) ’ wearing a shirt. 

8) ... <E»sn T t: ( does not) ( wear a shirt). 

(9) ... don't ( do not) ( wear a shirt). 

(0) Other 

NOTE: Child may have difficulty with a shirt. Do not score the double 
negative problem. Score only the tmderllned use of be. 



39. U&S Ot Pfl 

(In questions, main verb, baked, changes to bake with addition 
of did auxiliary) 

S (Point to mother) Ask the mother if she baked a pie? 



R (1) Did you bake a pie? 



I 

► 

$ 




Do you bake a pie? 

Does you bake a pie? 

Do you baked a pie? 

Does you baked a pie? 

Did you baked a pie? 

You baked a pie? (did omitted) 

You bake a pie? ( Hid omitted) 

Other 



ROTE: Child may confuse pronouns. Do not score his pronoun use. 
Score only the underlined use of do. 







Use Picture 3 
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40. COMPARISON 
(Comparative) 



Fish for supper is very good, but the 

i. a*. 1 • I#aj» U aAi mmm 

UUJf I IfVCO nut UU^d IHUMI • • • 



(1) 


... better. 




(2) 


... more. 




(5) 


... best. 


(superlative) 


(6) 


... bestest. 


(non-standard superlative) 


(7) 


• • • good* 


(positive) 


(8) 


... more good. 


(non-standard comparative) 


(9) 


... more better. 


(non-standard comparative) 


00) 


much. 


(adverb omitted) 


(0) 


Other 





41. oOubLe hegaTIVe 

(Negated main verb plus affirmative noun determiner or noun 
substitute: don't want plus any , more , or any more) 



S (Point to mother) 



The mother wants to know if the boy 
wants more milk. The boy says, 

"No, I don't want ... 



( 1 ) 

( 2 ) 

(3) 

(4) 

(5) 

( 6 ) 
(7) 
( 0 ) 



... any more (milk). 1 
... more (milk)." 

... any (milk)." 

... milk." 

.. . no more (milk)." 
... no mi1k. w 



none. 



Other 



Use Picture 3 
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42. SUBJECT-VERB AGREEMENT 
(no ending on main vert) 

S 

(Point to girl) 

(Point to father and boy) 
(If necessary, help 
child repeat) 



Look. Everybody is eating fish. 

The girl eats a little bit of fish. 

They ... 



R (1) ... eat (a lot, a little bit). 

(5) ... eats (a lot, a little bit). 
(0) Other 



43. SUBJECT-VERB AGREEMENT 
(/z/ ending on main verb) 



S 



(If necessary, help 
child repeat) 



Does the boy go outside to play after 
dinner, or does he go to bed? 

He ... 



R (1) ... jgoes (outside, to bed). (s^ pronounced /z/) 

(5) ... soes (outside, to bed). (s pronounced /s/) 

(6) ... cjoToutside, to bed). 

(7) ... goed (outside, to bed). 

(8) ... went (outside, to bed). 

(0) Other 



Use Picture 3 



MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 



Response Sheet 



Recording code: 1, 2. 3, 4 (standard); 5, 6, etc. (non-standard) ; 

0 (other) 

- If child answers with listed 

standard or non-standard response: Record response number 

- If child answers with unlisted 
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Category Sheet 
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Item Nunber 
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PAST TENSE - F 
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Item Number 
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The purpose of this sheet Is to rearrange 
the Response Sheet totals Into grammatical 
and phonological categories so that stu- 
dent weaknesses can be identified. 

DIRECTIONS: 

1. For each item, transfer the nwber in 
the Response Sheet *s TOTALS columns to 
the appropirate category on this sheet. 

2. For each category: 

a. Add the row and enter this number 
in the Total column. 

b. Compute the category percentage by 
dividing by the indicated nunber 
and entering it in the Percent col.* 

REMEMBER: Six rows are provided in each 
category* one row for each of six testings 
through the year. Only five students are 
tested at each testing, one a day for a 
week. 



♦If the Response Sheet is not based on 
five students, refer to the formulas on 
the back of the Category Sheet. 
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Following formula is for sample 
using more or less than 5 pupil j 
( no. pupils * N*). 
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Conceptual Oral Language Test 



Administration Manual 
(part one) 

and 

Technical Report 
(part two) 



John C. Larson 

Michigan Migrant Primary 
Interdisciplinary Program 



Part One 



Administration Manual 



DIRECTIONS FOR ADMINISTERING THE 



CONCEPTUAL ORAL LANGUAGE TEST 

This paper is intended to specify the procedures for administering 
the COLT. While it includes a brief comment on interpretation of the 
scores, the derivation and validation of the scores are described in 
detail in the technical report. The technical report provides infor- 
mation about the correlation of the COLT with other tests of language 
and general ability, and about the limitations of the research edition 
of the COLT in its present fora. 

The COLT was designed to assess the pupil's ability to solve prob- 
lems and think in terms of basic concepts in math, science, and social 
studies. The pupil indicates his answers in two ways: a) non-verbal ly, 
by pointing to the picture of his choice; and, b) verbally, by explaining 
his answer in standard English. Thus, a measure of the pupil's under- 
standing is obtained which is relatively free from the effects of dialect 
or language differences from the examiner. At the same time, the dis- 
crepancy betv/een the non-verbal and verbal score indicates the degree 
of the pupil's handicap in oral production of standard English. 

Part-scores can be obtained in the three content areas as an in- 
dication of the pupil's relative strengths in these subjects. In 
addition, part-scores can be obtained in each of the four basic processes 
as an indication of the pupil's conceptual ability to solve problems in 
certain ways. More exact definitions of these seven part-scores are 
elaborated in the technical report; hoirever, the analysis of the COLT 
in its present form suggests that the part-score reliabilities are too 
low as yet to be used as separate measures of ability. Thus far, only 
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the total non-verbal and total verbal scores are reliable enough to be 
of practical use. The total scores, then, may be interpreted as general 
measures of the pupil's ability to manipulate and express basic concepts 
in math, science, and social studies. 

The COLT is designed to be used as a sunmary measure of the overall 
effects of curriculum at the first-, second-, and third-grade levels, 
l.'hile the COLT is useful with pupils in the normal achievement range, 
it is also suitable for use with pupils who are in the lower achievement 
range because of their non-standard dialect. In fact, it is particularly 
valuable in identifying just those pupils who are low achievers only 
because of their non-standard dialect. 

General Test Considerations 

Optimal testing conditions are obtained when there is a friendly, 
cooperative relationship between the child and the examiner. While 
teachers are usually well enough acquainted with their pupils to have 
suitable rapport in an individual testing situation, strangers to the 
classroom may have to exercise particular care in establishing a trusting 
relationship. Children new to the school system, especially the low 
achievers, are often threatened by the prospect of having to perform 
alone with a strange adult. Casual conversation about the child's 
favorite interests, (e.g., the playground, favorite foods, pets, hobbies, 
etc.) often are successful in putting the child at ease. A few words 
prior to reaching the testing room about the nature of the child's 
task may be helpful in allaying the child's possible suspicions about 
going to the nurse's or principal's office. For example, explain that 
you would like to show him some pictures and talk with him about them. 
Mention that other children (or name a classmate) like to look at the 
pictures, and you think he will too. Often, interest in the examiner 
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and test is generated in the class as word of the pictures spreads. 

The examiner must also consider the physical comfort of the child 
in establishing optimal testing conditions. Testing rooms should be 
quiet, well-lighted and ventilated. It is best to use tables and chairs 
suited to the child's size. The picture booklet should be positioned 
at right-angles to the child's line of sight so that he can comfortably 
see and point to the pictures. The examiner should be alert for signs 
of fatigue or restlessness, since these factors lower the validity of 
the test. A brief pause between subtests to get a drink or stand and 
walk may be required. 

Specific Administration Procedures 

The test is divided into four formats, each with 15 items. The 
first two items of each format are demonstration items for the purpose 
of teaching the child how to respond to the format. Performance is 
not scored on these items. In each format, the two demonstration items 
are followed by three math, five science, and five social studies items 
in that order. Thus, there are 52 scored items out of the 60 itmes in 
the booklet. 

Since it is essential that the child knows the nature of the 
task for each format, much attention and explanation should accompany 
the demonstration items. If the child does not seem to understand the 
standard stimulus question, the examiner should use other words and 
gestures to elucidate the nature of the task, e.g. , pointing to each 
picture and asking or telling how it is the same or different from the 
others. The examiner should also elaborate the correct verbal answer 
for the demonstration items, whether or not the child has responded 
correctly. In this manner, the child will also learn the nature of 
the required verbal response. It may be necessary to rehearse the 
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demonstration items several times before going on to the test items. 
Once the test items have been started, of course, no further help 
may be given. 

The COLT is an un timed test; however, reasonable time limits may 
be used in pacing the items. If the child does not respond after about 
IS seconds, repeat the stimulus question for encouragement. Generally, 
if a child has not responded after one or two repetitions, he is not 
likely to respond at all without guessing. 

The examiner should encourage the child to respond to the test, 
but this encouragement must not be construed as a reward for correct 
answers, nor the absence of such encouragement as implied judgement 
of wrong responses. The sensitive process of maintaining rapport 
without cuing success or failure is often accomplished by using such 
non-comnittal phrases as "You're doing fine", “Let's look at another 
one", "That was a hard one, wasn't it?", or words to that effect. 

The first format is Differentiation. Each item is introduced 
with the following words: "Point to the picture that doesn't go 
(belong) with the others." The alternative the child points to is 
recorded as his non-verbal response. Imnediately thereafter, the 
examiner asks for the verbal response as follows: "Can you tell me 
why?", or, "Tell me why you chose that picture." The verbal response 
is then scored according to the criteria explained below. 

The second format is Classification, beginning with item 16. 

The following stimulus words are used* (pointing to the picture in 
the margin) "What goes with this ... (pointing in turn to each of the 
four alternatives) ... which one of these?" The verbal stimulus ques- 
tion is the same on all four formats, and is given imnediately after 
the non-verbal response to each item. 
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The Se nation format begins with Item 31. It Is Introduced as 
follows: (pointing In turn to the series of four frames) "These pic- 
tures are telling a story, but ... (pointing to the blank) ...one is 
missing." (pointing to the three alternatives) "Can you find it 
here?" The verbal stimulus Is given, then, after the non-verbal response. 

The final format. Analogies, begins with Item 46. The stimulus 
words are: (pointing to the upper, then lower picture of the vertical 
set of two pictures) "If this goes with this, then ... (pointing to 
the upper picture, then the blank of the other vertical frame) ... "this 
goes with what?"... (pointing to the three alternatives) ... "Which 
one of these?" The verbal stimulus, of course, follows. 

The verbal responses are scored on a three-point scale ranging 
from 0 to 2. Two criteria are employed In judging the adequacy of i he 
response: a) the generality of the concept; and, b) the appropriateness 
of the response In standard, "classroom" English. To receive a score 
of 2 for any verbal response, both criteria must be judged as 2. A 
score of 1 Is given if both criteria are judged as 1, or If one Is 
judged 1 and the other 2. A verbal response Is scored 0 If either 
or both of the criteria are judged 0. 

The generality of the concept expressed by the child is scored 
from 0 to 2, as Indicated In the examples below. Particular care must 
be given to scoring only the level of the words the child uses, not 
the concept Implied by the words. Often a child will respond cor- 
rectly to the non-verbal task, and apparently comprehends completely 
the nature of the Item. However, the words he uses to express his 
understanding are not of the highest conceptual power. The extent to 
which the child does. In fact, use more generalized, conceptual words 




is precisely what the verbal scale is intended to measure. Thus, In 
this case it is not just “the thought that counts". 

2- Abstract, or categorical words which subsume 
a group of pictures or an entire sequence of 



action under one category, e.g., 

a) "It's a car , "It's newer (faster)." (9) 

b) "They’re both in the same position, " (22) 

c) “They're all the same size ." (23) 

d) "It should start falling here." (38) 

e) "She needs food to cook." (45) 

f) "The bottom ones are closer. " (51) 

g) "A finger is part of a hand." (58) 



1- Descriptive or functional words which focus 
on a particular, distinguishing attribute of 
the category, or more global , imprecise ex- 
pressions for the criterion dimension; a com- 
plete action sequence implied but not iden- 



tified explicitly. e.g.. 



a) 


"It has a motor (steering wheel)." 


(9) 


b) 


"You blow that one." 


(14) 


c) 


"Both upside-down." 


(22) 


d) 


"They are all big, and these are all big." 


(23) 


e) 


"it's still on the tree." 


(38) 


f) 


"She doesn't have any food, so she buys some." 


(45) 


9) 


"it's still coming." 


(51) 


h) 


"Fingers go with hands." 


(58) 
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0- Idiosyncratic, simple labels, non-unique, or 



Irrelevant expressions of description or sequence, e.g. , 



a) 


"It has wheels." 


0) 


b) 


"It's a trumpet." 


(14) 


c) 


"Flower is next to the tree." 


(22) 


d) 


"There's three of them." 


(23) 


e) 


"It's on the tree." 


(38) 


f) 


"She's shopping for food." 


(45) 


g) 


"It's close." 


(51) 


h) 


"They're both fingers." 


(58) 



The verbal responses must be expressed In standard English; however, 
minor deviations in gramnar or pronunciation may appear in acceptable 

f ~ fm J 
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wnen tney render the meaning more vague, e.g., 

2- Concise, well -constructed expression of the 
concept. Should be a complete sentence. 

(See 2 a.-g. above.) 

1- Grammatically acceptable but verbose or in- 
direct, elliptical expression of the concept. 

Short phrases or single words which convey 
the essential meaning of the item criterion, e.g., 

a) "A horse pulls these, and you pull that, 
but that one goes by Itself." 

b) "You use your mouth to play that one." 

c) "These are all big and these are all big." 

d) "She doesn't have any food, then she buys 
some, then she cooks it and here they eat it.” 

e) "These are coming down the road." 



(9) 

(14) 



(45) 

(51) 
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0- One-word labels or broken phrases, e.g.. 



a) 


"Fast." 


(9) 


b) 


M A horn." 


(14) 


c) 


"The same." 


(22) 


d) 


"They're big." 


(23) 


e) 


"No food." 


(45) 


f) 


"Fingers." 


(58) 



Before administering the COLT, examiners should study the examples 
and the criteria of each Item In order to learn thoroughly the scoring 
system. The verbal responses accompanying each Item are Intended only 
as general guides and reminders, but do not exhaust the possible range 
of answers. 

Recording Answers 

The format of the COLT Is simple enough to allow objective recording 
of response on IBM sheets. For this purpose, the arrangement of the 
pictures has been designated as follows. 

For the Differentiation and Classification subtests, 
tir 7 pictures are lettered in the order of a written 
page as viewed by the examiner. 

S S 



■ 1 ■ H 

a. b. 


1 - 


< 

c. d. 





a. 


b. 


c. 


d. 



E 



E 
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For the Serlatlon ^;id Analogies subtests, the 
alternatives are again lettered In the order of 
a written page as viewed by the examiner. 



S S 



faTTj fb7| Ic7j | 




! 0 i^* i jjjj 

1 1 1 I 


zl r . i 




d b 



E E 



Care should be taken not to confuse these designations of the 
alternatives. Verbal scores can be recorded as judged on an IBM sheet 
by desisting alternative (a) as 1 point, alternative (b) as 2 points, 
and alternative (e) as 0 points. 
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Because of several inadequacies in existing measures of early 
educational development, the Conceptual Oral Language Test was devel- 
oped to assess basic cognitive processes in three content areas (math, 
science, and social studies) with both verbal and non-verbal scores. 
The construct validity of the test was analyzed by two methods: 
a) a multi trait-multi method matrix; and b) correlation with a stan- 
dardized group IQ test and an oral productive test. Results indicate 
that while the part-scores are not sufficiently reliable to be diag- 
nostically useful, the total non-verbal and verbal scores are meaning- 
ful. The higher correlation of the verbal than the non-verbal scores 
with the IQ test, together with the significant difference between 
the verbal and non-verbal scores in favor of the non-verbal , suggest 
a verbal response bias against bilingual and non-standard dialect 
speakers in tests of conceptual ability. 

With the rise of national interest in educating culturally dif- 
ferent minority groups, there came a proliferation of compensatory 
preschool and primary programs. The innovative Project Headstart and 
Title III programs brought with them a need for new educational eval- 
uation instruments (Turnbull, 1967). However, most standardized IQ 
tests and achievement batteries were inadequate to meet this new need 
for several reasons. Barritt (in press) has argued that the single 
score IQ test, even though it may predict future school success, "does 
not provide information about intra- and inter-individual differences, 
and their interactions with various learning programs". Also, in- 
telligence is not specifically defined, thus an IQ score can easily 
be misinterpreted. 

Many standardized achievement batteries fare little better as 
measures of early elementary curriculum. The cognitive abilities 
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requi red for these tests are too often confined to factual recall 
rather than productive comprehension of basic concepts. Scores are 
typically given for math and language with little attempt to assess 
learning in science, and virtually no scores for social studies in 
the early grades. The only major standardized achievement battery 
to assess social studies In the lower primary grades provides a vo- 
cabulary test of words drawn from geography, economics, and science, 
but it Is not designed for use before grade level 2.5. 

The greatest single inadequacy of both standardized IQ and achieve- 
ment batteries for assessing compensatory early education curricula is 
their reliance on the verbal mode of response, either in reading, 
writing, listening or speaking. Since most of the compensatory programs 
are desicpied for non-standard-dialect or bilingual populations, any 
attempt to measure the cognitive development of such students should 
discriminate between conceptual functioning and verbal coneunl cation 
ability as suggested by Glick, (1968). The absence in these standard- 
ized tests of non-verbal response inodes restricts their usefulness In 
measuring early educational development. 

Rationale of the Test 

The Conceptual Oral Language Test (COLT) was designed as an Indi- 
vidual test for the lower primary level to assess basic thought pro- 
cesses in three content areas; math, science, and social studies. With 
a verbal and non-verbal scoring method for each item, it is suitable 
for use with compensatory programs for bilingual and non-standard- 
dialect populations. 

Four basic cognitive processes are operationally defined in four 
item formats. The first, differentiation, requires discrimination 
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be tween four pictures to determine the "one that doesn't belong with 
the others." The second, classification, requires grouping a stimulus 
picture with one of four other pictures which shares a common attribute, 
or "goes with" the stimulus picture. The third format, seriation, is 
essentially a picture arrangement task. It requires a process of in- 
duction to infer tdiich of three alternative pictures is missing from a 
series of pictures. The fourth, analogies, requires the inference and 
transfer of a common relationship between two sets of pictures. 

Evidence for the primacy of these basic cognitive processes is 
suggested by several sources. While there is no clear agreement about 
what constitutes basic cognitive processes, there is a convergence on 
the four general areas outlined above. Bruner (1956) has explored the 
classification activity of children as a basic, elementary method of 
processing data. Similarly, Lermeberg (1967) has characterized the 
ability to form stimuli equivalences as basic to conceptualization. 

He also notes that .stimulus generalization and stimulus discrimination 
are complementary processes. Thus, there is some justification for 
the notion of differentiation and classification as basic cognitive 
processes. 

Other considerations suggest that the more complex Inference 
processes may, in some sense, be basic to cognitive functioning. 

Stimuli which are discriminated end classified must somehow be inter- 
related or systematized if the person is to function successfully in 
the environment. The process of interrelating categories can be 
thought of as induction and deduction. Guilford (1959) has concep- 
tualized convergent and divergent processes as two of five general 
cognitive operations. While the existence of these operations has 
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not been validated across all age levels, they appear to have some 
descriptive value in accounting for cognitive functioning. In addition, 
the existence of inference processes in young children has been hy- 
pothesized by ficKeill (196C) to account for the infant's ability to 
systematize the language he hears into syntactic rules. 

Piaget (Flavell, 1963) has characterized the cognitive development 
of the child from "pre-logical" to “concrete-operational" between 4 
years and 7 years of age. With his "transductive" logic, the 4-year-old 
relates particulars to particulars where no necessary relationship exists, 
while the more systematic 7-year-old can relate particulars according 
to logically necessary relationships. The difference between trans- 
ductive and deductive reasoning seems to be more in content than form, 
however, if the same basic, inferential cognitive processes are seen 
to operate in both cases, though upon more logically primitive data 
in the younger child. (In this sense, content Is Interpreted as the 
sum total of factual knowledge and logical organization available to 
the child.) Thus, basic cognitive processes can be seen to include 
induction and deduction in addition to differentiation and classification. 

In a review of a body of research on cognitive variables, Gallagher 
(1S64) has noted seme convergence on the conceptual styles which Kagan, 
Moss, and Sigel (1963) have called anal yti c-descri pti ve , inferential 
categorical , and relational. These three styles refer respectively 
to: (a) the ability to differentiate the environment; (b) the ability 

to draw conceptual similarities between perceptually different stimuli; 
and (c) the ability to develop functional relationships between stimuli. 
Stemmier (1967) reports having developed a Language-Cognition Test for 
educational purposes. For the conceptual scoring system she focused 
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on three categories; inductive, deductive, and analogical reasoning. 

While these categories are not isomorphic with those of the COLT, there 
is considerable overlap in their meaning. 

Since the COLT was intended for use in the first three primary 
grades, the content for the basic cognitive processes was selected from 
the general elementary curriculum of math, science, and social studies. 
Thus, the test scores reflect basic thinking processes in these three 
content areas rather than factual recall. The math content is defined 
as number sets, number series, operations (addition and subtraction), 
and proportions. The science content is defined as physical dimensions 
(size and shape), spatial dimensions (distance, direction, and position), 
and temporal -spatial relations. The social studies content is defined 
in terms of personal -soci al relations, namely: characteristics (age, 
sex); social roles (teacher, mailman, etc); and resources (from home, 
school, and community). 

Construct Validity 

Several hypotheses regarding the construct validity of the COLT 
can be derived from the rationale explained above. The hypotheses 
stated below refer to two separate areas: a) the internal organization 
of the test itself; and b) its correlation with outside criteria. 

The item specification chart (table 1) of the COLT contained 12 
cells in a two-way table of 4 basic processes by 3 content areas. The 
set of hypotheses outlined below was developed to validate this structure, 
using a variation of the mi ltitrait-nulti method matrix reported by Campbell 
and Fiske (1959). Essentially, this matrix indicates the tendency for 
several methods of measurement to converge upon a single trait. Also, 
it indicates the degree of discrimination between traits. For this 
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purpose, eight groups of correlation coefficients were analyzed and 
compared. The hypotheses concern the rank order of these groups, as 
illustrated in table 2. 

H,: The reliabilities of the 12 non-verbal and 12 
verbal cells (r_) are higher than all other 
coefficients in' the matrix. 

H ? : The convergent validity of each of the 12 cells 
L measured across methods (rg) is significantly 
greater than zero. 

H3: The groups of seven covergent and discrimination 
coefficients in table 2 are of decreasing homo- 
geneity. Thus, they are rank-ordered as follows: 

F 2 > F 3 > F 4> F 5> F 6 > F 7> F 8 



TABLE 1 

COLT Item Specification Chart 



Areas ! 


Di f ferenti ati on 1 


1 Classification ! 

t 


Seri ati on 


Analogies 


Math 


1 

3,4,5 


1 

18,19,20 


33,34,35 


48,49,50 


Science 


6,7,8,9,10 


21 ,22,23,24,25 


36,37,38,39,40 


51 ,52,53,5^,55 


Soci al 
Studies 


11,12,13,14,15 


26,27,28,29,30 

1 

i 


41 ,42,43,44,45 

I 

f 


56,57,58,59,60 



NOTE: Numbers in the cells refer to the item numbers on the final 
version of the COLT. 
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For each item on the COLT there Isa non-verbal and a verbal score. 
The non-verbal scoring system should be relatively free from Influences 
due to dialectal or language differences between the examiner and the 
subject. Since the criteria for the verbal scoring system require the 
subject to express the concepts In standard "classroom 11 English, sub- 
jects with non-standard dialects should obtain higher non-verbal scores 
than verbal scores. 

H 4 : tilth subjects identified as having a non-standard 
dialect, non-verbal score is greater than verbal 
score. 

H 5 : COLT verbal scores correlate higher with a test 
of oral language production In standard English 
than COLT non-verbal scores. 

Since most group 10 tests available for classroom use are hy- 
pothesized to have a strong verbal factor, the student with a non- 
standard dialect is at a disadvantage In displaying his conceptual 
ability because of the verbal response style. Thus, 

H 5 : COLT verbal scores correlate higher with a 
standardized group IQ test than COLT non- 
verbal scores. 

The COLT was designed to measure basic cognitive processes. It 
Is hypothesized that the cognitive structure of the Individual develops 
out of an interaction of these basic processes with environmental data. 
It is also hypothesized that language develops out of Interaction with 
environmental data. If the linguistic environment varies between, or 
within, cultures more than the non-linguistlc environment, the develop- 
ment of non-verbal processes should be more uniform with age than the 
development of anv particular verbal processes. Thus, . 

Hy: COLT non-verbal scores correlate higher with 
chronological age than the standard English 
COLT verbal scores. 
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Method 

Test Design 

Table 1 illustrates the Item specification chart for the COLT. 

Items were developed for each of the 12 cells according to the definitions 
of the content and process noted above. Given these definitions, the 
test is designed to obtain a balance of content areas within the four 
processes, and a balance of processes within each content area. 

Non-verbal scores were obtained by the subject's pointing to the 
alternative of his choice. The verbal scores for each item were based 
on two criteria: a) generality of concept; and b) adequacy of comnunl- 
cation in standard English. Each of these categories was judged on a 
three-point scale ranging from two to zero. The two-point level of 
generality required expression of an abstract or generalized word or 
idea, e.g. "It's a car". One point was scored for more concrete, des- 
criptive terms, e.g. "it has wheels," “you ride in it". Irrelevant 
concepts were scored zero. A two-point score for adequacy of expression 
was given for a concisely stated, economical expression of the concept. 
While grammatical usage was not scored, the expression had to be a com- 
plete sentence, e.g. "He's running around the bases". One-point scores 
were given fGr more elliptical, imprecise expressions of an acceptable 
concept, e.g. "First he's here, then he runs there, then there, and he 
runs there". Idiosyncratic expressions were scored zero. 

In general, to be scored "2", a response had to reflect the two- 
point level of both criteria. Responses were scored "1" if they reflected 
the one-point level of both criteria, or two points in only one of them. 
Responses which reflected the zero-level on either criterion were scored 



zero. 



- 10 - 





Two field trials and revisions were conducted in developing the 
final version of the COLT. For the first draft, 104 items were designed 
and divided into two equivalent forms to keep the administration time 
within approximately one-half hour. One form was given to 23 subjects, the 
other to 18 subjects. The subjects were selected randomly from first 
grade classrooms in schools generally characterized as lower-middle- 
class. On one of the forms, however, eight third-grade subjects were 
tested. Items were redesigned or deleted according to their difficulty 
level and power of discrimination. 

The second draft, containing 52 items, was administered to 30 first- 
grade subjects from the same schools as the first group. Since the final 
version of the COLT was intended to measure first-, second-, and third- 
grade performance, the items of the first and second drafts were adjusted 
to yield approximately 30 percent passing for the first-grade population. 
The final version of the COLT contained 52 test items, distributed as 
indicated in table 1, together with two practice items at the start of 
each of the four item formats. Typical administration times for all 
60 items ranged from 25 to 35 minutes. 

Research Design 

The subjects for the present study were drawn from 12 first-grade 
classrooms, two of them from a rural school and the rest from urban 
schools. The subjects generally came from lower-middle- to lower-class 
families. Since the COLT was being administered in conjunction with a 
language development curriculum, the subjects were selected from the 
lower half of the achievement range in the classrooms, as judged by the 
teachers. Consequently, many of the subjects had language interference 
problems due to non-standard dialect or bilingualism (Spanish). Twenty- 



o 
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eight females and 21 males were selected. Mean chronological age * 87.3 

months, 5.D. * 8.3 months. Mean IQ * 89, 5.D. - 12.96 as measured by the 

— 

Cognitive Abilities Test, primary I, form 1 (Thorndike, Hagen, and 
Lorge, 1968). 

Two other tests were administered concurrently with the COLT; the 
Cogiitlvc Abilities Test, primary level I, form 1 (CAT); and_the Michigan 
Oral Language Productive Test (MOLPT). The CAT was selected as a well- 
standardized, group test of general ability in school achievement. The 
MOLPT was selected as a measure of general speaking ability in standard 
English. The total score of the MOLPT is the sum of several parts testing 
grammatical performance and prt^unciation. The three tests were adminis- 
tered in randomized order. 

Results 



Construct Validity 

The Internal orgainlztion of the COLT was investigated by use of a 
multi trait-multimethod matrix (Campbell and Fiske, 1359). Evidence for 
the validity of a trait is Inferred when two different methods designed 
to measure the same trait converge in a significant correlation coefficient. 
Discrimination between various traits is Inferred when their intercorre- 
- latlons are significantly lower than their reliabilities. Traits measured 

~~ by the same method should Intercorrelate higher than if measured by two 

different methods. Thus, further evidence for the validity of the traits 
and the methods is inferred from the rank order of correlations In de- i 4 
creasing degrees of homogeneity from the monotrait-heteromethod discrim- 
ination, to the heterotralt-heteromethod discrimination. 

; * 

The matrix in table 2 represents an extension of the two-way matrix 
reported by Campbell and Fiske. The methods are coaposed of non-verbal 

'eric 
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and verbal scores. The two traits are composed of the four basic pro- 

rf 

cesses and three content areas. Thus, there are seven dlsceroable groups 
of homogeneity In addition to the reliability coefficients. It was 
hypothesized that the methods were more homogeneous than any of the 
traits. The difference between methods is primarily one of the response 



style which would appear more superficial than the distinctions between 
cognitive processes and content areas. It was further hypothesized that 
the cognitive processes would be more homogeneous than the content areas. 
While the three content areas bear no necessary relationship according 
to their definitions, the basic cognitive processes should reflect at 
least a psychological association. Thus, the seven correlation groups 
should be rank-ordered as indicated in table 2. 

The obtained correlations in table 3 indicate that reliability for 
the individual cells of the Item specification chart Is lacking In both 
the non-verbal and verbal methods. The mean coefficient (KR-20) for the 
12 non-verbal cells was .12, and for the 12 verbal cells .25. Thus, 

H. must be rejected since the cells are not sufficiently homogeneous 

* J 

to constitute a meaningful unit, of measurement. 

The homogeneity of each of the 12 non-verbal and 12 verbal cells 
(reliability) must exceed the square of the validity coefficient In 
order to Infer measurement of the distinct domains hypothesized In the 



Item specification chart (Cronbach, 1949). This condition, however, 
was not met, as can be seen by a comparison of the reliability coef- 



ficients (r v ) with their convergent validity coefficients (r^) In table 3, 
Yet, the fact that the 12 validity coefficients are, with one exception, 
significantly greater than zero suggests that the verbal and non- 
verbal methods do converge-on the unitary traits designed in the Item 



specification chart. Thus, Is not rejected. 
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In spite of the low reliability of the cells, there was a significant 
ordering of the degrees of homogeneity of the correlation groups represented 
in table 2. first, an analysis of variance (table 4) was conducted on the 
seven groups to determine their heterogeneity (F=10.79, p*.0Q1). The ob- 
tained rank-order of the seven groups was then compared to the hypothesized 

i 

order as shown In table 5. Kendall's tau statistic (Hays, 1963) of .905 

I 

I 

indicates that there Is 90% agreement between the predicted and obtained 



#’ 



TABLE 4 



1 

\ 



Analysis of Variance on Seven \ 
Groups of Correlation Coefficients from table 3 



*p <,.001 



SOURCE 


df 


MS 


\ 

i 

'• F 










Correlation 






— 


groups 

i 


6 

• 

r 


2285.45 


-10.79* - 


Error ! 269 


211.70 





rank orders of the groups. Is thus accepted as evidence for the va- 
lidity of the Internal structure of the COLT. 

Since the usefulness of the 12 cells in the Item specification chart 
was not reliably established. It was necessary to determine the significance 
of the four cognitive process scores as well as the three content area 
scores. These part scores should be reliably established to be of educa- 
tional, diagnostic use. Consequently, the multi tra1t-mul%i method matrix 
was repeated for both of these traits across verbal and non-verbal methods. 

Table 6 represents the multi trait-multi method matrix of the four 
cognitive processes and twojnethods. While the four processes demonstrate 
higher reliability than the Individual cells, the rellabllltles- 
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FABLE 5 



a 



Comparison of Predicted and Observed Rank-orders 
of the Seven Correlation Groups In Table 3* 







TABLE 6 

Mul tl tral t-hul tl method Matrix of 
Four Basic Processes and Tuo Methods, N«43 







Basic Processes 


: Non-Verbal 


Basic Processes: Verbal 






Differ. 


Class. 1 


Ser. 


Anal. 


Differ. 


Class. 


Ser. 


Anal. 




D 


.45 








r 










C 


.39 


.17 








— 






N#v 




















Verbal 


S 


.51 


.31 


CM 

CM 

• 








- 




; 


A 


.04 


.18 


.33 


.33 


* 






- 




0 


.74 


. .36 


.47 


.12 


.61 






- 




C 


.54 


.44 


.41 


.23 


.54 


.67 






Verbal 


S 


.40 


.33 


.53 


.28 


.49 


.55 


.73 




* 


A 


.20 


.07 


.38 


.45 


.28 


.41 


.47 


.71 



& 



NOTE: Three groups of correlation coefficients, beside reliability* are 
derived as follow In decreasing degrees of homogeneity: 

r 2 -Monotra1 t-Heterome thod , mean r».540 

r^Heterotral t-Monomethod , mean r*.35 

r^Heterotralt-Heteromethod, mean r*.32 
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of the non-verbal scores (mean *.29) are still too low to be useful . 

The verbal process score reliabilities approach greater significance 
(wean *.68). In fact, the reliabilities of each of the verbal processes 
exceeded their convergent validity coefficients. This was not true, however, 
for the nonverbal processes. As In table 4, the three groups representing 
decreasing degrees of homogeneity are significantly different, as Indicated 
In table 7 (F*3.4S, p £.05). The three groups also are rank-ordered as 
hypothesized In decreasing degrees of homogeneity. Thus, the validity of 
the construct of four processes as measured by two methods 1$ supported 
b y th e se re sults; how eve r , - the non-ve r bal "p r ocess re11ab111t1cs~^nrtoo 
low to be diagnostically useful. - 

Table 8 represents the parallel analysis of the three content areas 



TABLE 7 

Analysis of Variance on Three 
6roups of Correlation Coefficients from Table 6 



SOURCE 


df 


MS 


F 


Correlation 




r 




groups 


2 


754.10 


3.49* 


Error 


25 


216.24 


— 



*p< .05 

as measured by the two methods. The mean reliabilities for the three con- 
tent area part-scores are .47 In the non-verbal method and .64 In the verbal 
method. While this Indicates some leprovement in the non-verbal method, 
the part-score reliabilities are still too low to be diagnostically usefiil. 
As In table 7, table 9 supports the construct of three groups of corre- 
lations of decreasing degrees of homogeneity (F-5.21 * p£.025). The three 
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Multi tratl -Multimethod Matrix of Three 
Content Areas and Two Methods, N*49 





Content Areas: Non-Verbal 


Content Areas: Verbal 




Math Scl. Soc. Study 


Math Scl. Soc. Study 


M 

Non- Sc 

Verbal $s 


.44 

.34 .43 

.46 .28 .53 




M 


.69 .45 . 27 


.51 


Verbal Sc 


.46 .59 .35 


.63 .73 


Ss 


.42 .33 .62 


.55 .66 .67 



MOTE: Three groups of correlation coefficients, besides reliability, 
are derived as follows In decreasing degrees of homogeneity: 

^■Honbtralt-Hetercmethod, mean r».63 

r 3 *Heterotra1 t-Heterometbod , mean r-.49 

r^Heterotralt-Heteromethod, mean r».38 

groups are ordered as predicted. These data support the construct three 
content areas measured by two methods. 

The obtained total score reliabilities were .714 non-verbal and .949 
vevtal. With standard deviations of 5.7 for the non-verbal and 7.19 for 
the verbal score;, the standard errors of measurement are 3.99 and 2.49 
respectively. Thus, the non-verbal and verbal total scores of the COLT 
are considered educationally useful measures of general cognitive pro- 
cesses In the three content areas; however, the part-scores are not suf- 
ficiently reliable to be diagnostically significant. 
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Analysis of Variance on Three 
Groups of Correlation Coefficients From Table 8 



SOURCE 


d* 


HS 


F 


Correlation 

groups 


2 


652.25 


5.21* 


Error 


12 


125.29 





*p 5 .025 

Concurrent Validity 

As Indicated above, the non-verbal and verbal total scores of the 
COLT were correlated with the CAT, (a standardized, group IQ test), the 
HOLPT (an Individual test of oral production In standard English), and 
chronological age. The data In table 10 generally support the predicted 
pattern of correlations between these measures. As a measure of general 
ability, the COLT verbal scores correlate relatively well with the stan- 
dardized group IQ test (.67). Yet, because of the strong verbal factor 
hypothesized to be present In the standardized IQ test, the COLT non- 
verbal scores correlate only .47 with the CAT. The difference between 
these correlations Is significant at the .02 level of confidence. Thus, 
Hg cannot be rejected. The mean for the COLT non-verbal scores was 
20.8 (S.D.*6.02), while that of the COLT verbal scores was 17.22 
(S.D.»7.89). The difference between the two COLT scores was significant 
at the .01 level (t*2.52, 96). Thus, H 4 cannot be rejected. This dif- 
ference, together with the higher correlation of the COLT verbal scores 
with CAT, suggest a significant bias of response style against the 
bilingual and non-standard-dialect populations when their general 
ability Is assessed with standardized group IQ tests. 
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The three tests were correlated with chronological age, under the 
hypothesis (H ) that Increases In the non-verbal COLT scores are associated 
with the progressive deveTopment of general cognitive structures across 
age, while Increases In the verbal COLT scores are more associated with 
specific development In standard English In addition tp cognitive devel- 
opment. The zero-order correlations of these scores with chronological 
age. Indicated In table 10, do not support this hypothesis. These low 

correlations are probably most economically explained In terms of the 

n-- 

narrow range of age relative to stages of cognitive development 
(Havell, 1963). 



TABLE 10 



Intercorrelatlons of COLT Verbal and Non-Verbal 
Scores with Criterion Measures and 
Chronological Ag* (C.A.), N«44 





r COLT 

. . M-V 


COLT 

V 


C.A.T. 
raw score 


MOLPT C.A. 

In months 


COLT 










H-V 










COLT 


.666 








V 


- 






* 


C.A.T. 


.470 


.669 






MOLPT 


.299 


.545 


.448 


A # 


C.A. 


.024 


-.036 


.179 


-.21 



The pattern of correlations with chronological age Is more Interesting 
from another point of view. It Is assumed that older subjects are retained 
In the first grade, where the data were collected, because of low school 
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achievement. Thus, variables which correlate negatively with chronological 
age at a given grade level are associated positively with school failure* 

It would appear, from the correlation of -.21 between the M0L?T and 
chronological age, th,. school failure Is due more to Inadequacies in 
speaking standard English than to conceptual Inadequacies. Conceptual 
ability as measured by the COLT seems to have essentially no correlation 
with school failure. 

The final hypothesis considered (H_) Is that the COLT verbal scores 

5 

correlate higher with standard English speaking ability than the COLT 
non-verbal scores. The difference between the non-verbal (.30) and 
verbal (.55) correlations with the MOLPT is significant at the .03 level. 

Thus, the testing of the conceptual ability of bilingual or non -standard- 
dialect speakers by both non-verbal and verbal response modes seems 

justified. 

* 

Discussion 

In Its present form the COLT does not function as Intended. Tile 
most serious problem is the part-score reliabilities. In both verbal and 
non-verbal methods, of the four basic processes and three content areas. 

am 

The low part-score reliabilities prohibit diagnosis and treatment of 

% ) 

specific deficits In the student's learning. With adequate reliability ] 

only In the verbal and non-verbal total scores, the use of the COLT is 
restricted to assessing summatlve effects of school learning. 
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Future Improvement of the COLT Is Indicated In several areas. The 
present analysis is based upon data from only the lower half of the first* 
grade ability range. Since the COLT 1s Intended for a criterion measure 
of school achievement In the first-, second-, and third-grades, the per- 
formance of the test in Its present form should be determined across 
these three levels. 
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Given data from the three grade levels, reliability. can be Improved, 
of course, through appropriate Item revisions. An additional change In 
format, however, may also Improve the reliability. The first-grade sub- 
jects often gave Indications of fatigue toward the end of the half-hour 
testing period. Rather than subjecting every pupil to every item, error 
variance due to fatigue could be partially controlled by using a basal - 
celling system to cut short each of the four item formats after a series 
of failures. With items from the three content areas tested alternately 
one after the other at Increasing levels of difficulty, each of the three 
content areas could still be equally sampled within each basic process 
befbre the ceiling is reached. A basal-celling system of scoring would 
also allow for a greater range of difficulty of the part-scores with no 
Increase In testing time. 

From data gathered over a wider age range, the Items should demon- 
strate an age gradient of decreasing difficulty. The four basic pro- 
cesses are intended to assess developmental changes In the Individual 
cognitive structure across time. White (1965) has summarized from a 
wide range of theories a number of changes In the ch11d*s cognitive 
func timing between the ages of 5 and 7 years. These changes should 
reglstc^ on the cognitive processes measured by the COLT. 

It should be noted that; the verbal scores used In this analysis 
were based on a two-point scoring system rather than the Intended three- 
point scale. Comments from the examiners after the testing had been 
completed Indicated that there was some difficulty In discriminating 
one- and two-point responses for many Items. Little difficulty was 

t 

reported, however. In distinguishing the zero-point from the one-point 
responses. Thus, the one- and two-point verbal responses were corttlned 
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for a vatae of one. The three-point verbal scoring system should be 
tested further at the second- and third-grade levels to determine Its 
usefulness In the upper ability range of the test. 

The results support the hypothesis that pupils Identified with lan- 
guage handicaps relative to standard English are penalized on tests of 

jV 

conceptual ability because of the response styls required. This hypothesis 
should be cross -validated with a sample of children, Identified as having 
no handicap relative to standard English. Results should Indicate no 
significant difference between their conceptual score and their ability 
to express their reasoning In standard English. 

As a test of basic cognitive processes In three content areas, the 
COLT was designed to be a sunmatlve, criterion measure of school achieve- 
ment. For any such test, predictive validity Is essential. Particularly 
of Interest Is the relationship of future school achievement of the 
conceptual score with the verbal score held constant, as well as the 
predictive validity of the verbal score with the conceptual score held 
constant. These relationships may vary with the grade level. For ex- 
ample, verbal skills may be more important In the earlier grades, and 
conceptual skills later when the curriculum Is more complex. Such In- 
formation Is valuable for curriculum planners as Well as classroom 
teachers. 

A test such as the COLT, with the refinements Indicated above, 
has several Implications for the field of educational measurement. 

Deutsch an c Fishman, et el. (1964) have underlined the problems asso- 
ciated with testing minority group children. Included In their list 
of factors which reduce the validity of standardized achievement and 
ability tests are the mode of response and the speed factor. 6Mck (1968) 



has characterized the same probleas under threi Issues: 1) the dis- 
tinction between capability and performance; 2) the distinction between 
process and achievement; and 3) the nature of developmental change* 

The answer to what a test really measures cannot accurately be determined 
without the test being sensitive to these factors. Results from testing 
with the COLT Indicate that It Is, In fact, measuring two separate areas 
with minority group children, depending upon the response style used. 

Several other Instruments for assessing general ability are available 
which do not rely upon a verbal response style; however, their use In 
classrooms fbr minority group children is restricted by at least two 
factors. The Peabody Picture Vocabulary Test was designed to measure 
general ability through a non-verbal, pointing response to pictures. 

While no oral productive skills are required of the subject, the score 
Is clearly affected by the subjects passive exposure to nouns and gerunds 
In standard English. The Wechsler Intelligence Scale for Children and 
the Wechsler Preschool and Primary Scale of Intelligence provide both 
verbal and non-verbal measures of general conceptual ability. In addition, 
however, to the problems noted by Barrltt (In press) In using such tests 
to measure educational progress, there Is the difficulty of defining the 
difference between non-verbal and verbal scores which are based on different 
Items. There would appear no clear way to discriminate the effects of 
response style a rone when the Item content also varies between the verbal 
and performance scales. 

In closing, one final Issue relevant to elementary curriculum and 
achievement criteria Is raised by the COLT. Deutsch and Fishman, at al. 
(1964) have stressed the Importance of measuring capacity for development 
In the education of minority group children. It Is clear that a curriculum 
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composed of a static Inventory of facts and vocabulary Is no longer 
adequate for a society In which the sun total of knowledge doubles every 
ten years* Basic cognitive processes as neans of dealing with Inter- 
disciplinary concepts mist become the criteria of modem education. 
However, If the COLT Is a measure of these basic cognitive processes, 
the results of the present study suggest that the retention of older 
studehts In the first grade Is not related to their conceptual ability 0 
but more to their ability to express themselves In standard English. 

As material and financial resources become more and more available for* 
the development of compensatory education programs. It Is essential that 
the criteria of the curriculum clearly reflect the needs of our modem, 
changing society. 
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3. 

0- insufficient: Has flat car. Has oil car. Has caboose. 

1- descriptive: Has five (three) cars. It's bigger (smaller). 

2- categorical : Has more (less). It's longer (shorter). 
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4. 

0- insuffi cient : It's longer. It's more. Starts with 3. 

1- descriptive : It's the only one with 7 (2) in it. Only one without 5. 

2- categorical: The 2 is missing. 
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0- Insufficient : Shape (round, triangle) 

T- descriptive : ‘less, skinnier, llttler, longer part, 
2- categorical" : half, not half. 
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6 . ' 

0- Insufficient : They point that way. 

1- descriptive? The' middle arrow is* wrong. 

2- categorical : The two outside ones point the same way. The middle one points 

the opposite way. 
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7. 

0- insufficient: That's a boat, a dog, and a boy. You live in it. 

1- descriptive: It's sitting the wrong way. 

2- categorical: That'.s on it's side. Those are right-side- up. 
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8 . 

0- Insufficient: 

1- descriptive: 

2- categorical: 



It’s an ice cream cone. It s round, 
his one (cone) doesn't have any lines over it. These use fire, 
his is food, others aren't. Those are hot, this is cold 
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9 . 

0- Insufficient: 

1- descriptive: 

2- categorical:, 



You drive It. It has wheels. 

M has a motor. Has a steering wheel . You pul 1 these. 
It goes faster. It l s newer (more modem). 
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10 . 

0- Insufficient: 

1- descriptive: 

2- categorical: 



It's made of metal (wood). 

Rain Is soft, those are hard. Water Is runny, those aren t. 
The others are solid. Water Is wetj those are dry. 

Those are all man-made. 
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0- insufficient: That one has a clothesline. He's bigger. 

1- descriptive: She's hanging clothes, she's raking, and he's digging 

but he's playing ball. 

2- categorical: He's playing, they're working. 
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12 . 

0- insufficient: It doesn't have a point. It's a paint brush. 

1- descriptive: The end (point) is bigger. That's for art class, those are for 

writing. 

2- categorical: You draw with these, paint with that. 

You write with these, paint with that. 



13 . 

0- insufficient: You wear it; That one has money. 

1- descriptive: That belongs in your pocket, those don't. 

2- categorical: That's a man's (for Daddy), those are a lady's (for Mommy). 
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14 . 

0- insufficient: That one uses sticks. You hit It. 

1- descriptive: You blow that one. You hit all these. 

You use your mouth on that one. These are flat, that isn’t 

2- categorical: That's a brass instrument, those aren't. 
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15. 

0- Insufficient: I like that more. You buy It. 

1- descriptive: They all have skins. That one melts. They grow on trees. It's colder 

2- categorical: It‘s a treat. Those are fruit. That‘s man made 
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18. 

0- insufficient: 

1- descriptive: 

2 - categorical: 



It has the most points. 



Dth shaped like a house 
t‘s upside down Both 



Both like a box. 

. Both have 5 sides (points), 
have same number of sides. 
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19. 

0- insufficient: Should start with "l". 7 comes before 8. 

1- descriptive: They both have a "S 11 ("2"). 

2- categorical: They go up by "2's". Each number is 2 more than the last. 
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20 . 

0- insufficient: 

1- descriptive: 

2- categori cal : 



B°th r°und. You buy the cake with the Dennv 
They both have only part. ^ y ' 

They both show half. Half is missing from both. 
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21 . 

0- insufficient: They're both like squares. Both big. 

1- descriptive: Both balls are under. 

2- categorical: The balls are in the same position (place). 
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22 . 

0- irrelevant: Flower next to tree. 

1- description: Have leaves. Both grow. Both upside-down 

2- categorical: They’re in the same position. 
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23. 

0- irrelevant: There's 3 of them. 

1- descriptive: These are all big and these are all big. 

2- categorical: The same size. 



24 . 

0- Insufficient: Pointing that way. The same. 

1- descriptive: The middle part is little. 

2- categorical: It's the same shape. 



o 



ERIC 




fit 





|J_J 




o 

ERIC 



0- * insufficient: You write the paper with a typewriter. 

1- descriptive: You have to look at both. The paper comes in the mailbox. 

2- categorical: They both tell the news. 
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25. 

0- insufficient: They both grow. Both have leaves. Both in garden. 

1- descriptive: Both ready to eat. Can eat them both. 

2- categorical: They're both ripe. Both have fruit (vegetable). 






27 . 

0- insufficient: 

1- descriptive: 

2- categorical: 



He carries milk. 

Both come from the post office. 

The mailman delivers (gives, carries) packages. 




28 . 

0- insufficient: Two girls go together. That's the teacher's desk. 

1- descriptive: Teacher sits at her desk. She reads from the book. 

Chalk is missing. 

2- categorical: Needs chalk to write. 
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29. 

0- insufficient: They're both from a farm. 

1- descriptive: Milk (cheese) comes from cows. 

2- categorical: Meat (steak) comes from steers (cattle). 




30 . 

0- Insufficient: Same size. 

1- descriptive: That’s five cents and that's five cents, (a nickel). 

2- categorical: Same amount of money. Five pennies are a nickel. Both five cents. 
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33. 

0- insufficient: 5 conies after 4. 7 comes before 8. Has to be 6. 

1- descriptive : They're all eyen numbers. 

2- categorical": It's counting by 2's. 4 plus 2 equals 6. 



34 . 

0- insufficient: 

1- descriptive? 

2- categorical": 



He took them all down. It * i little. He's taking it apart. 

He‘s building it up (knocking it down). That has 4, that has 3.... 
He's subtracting. He's taking one off each time. There's 
less on the pile. It's getting shorter. 
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35 . 

0- insufficient : He's got one there. There's three. 

1- descriptive: He's got none there and one there 3^jjs less than 4. 

4 there and three there. 

2- categorical : He’ker s on getting more. It keeps on getting less. 
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36. 

0" insufficient: Almost home. Running up. 

1- descri ptive : Running around the bases. 

2- categorical : 3rd comes next. 3rd is cfter 2nd base (before home). Has 

touch 3rd. 




37. 

0- insufficient: There's more (less) water). 

1- descriptive: It's tipping over. It fell over. 

2- categori cTTT Water should stay flat (level). 
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38. 

0- Insufficient : Big one. it's on the tree. 

1- descripti vi T It's on the same side. It's still on the tree. Should start 

here. 

2- categorical : It starts falling here. 
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39 . 

0- insufficient: Cuz s they're sideways. They're going up. 

T- descriptive: The girl's up, now she's down. They stopped playing. She's 

suppose to be going up. First she's up, then she's down. 

2- categorical! The teeter-totter (seesaw) goes up and down. They take turns 

going up. 
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40 . 

0- insufficient: They're all gone. 

1- descriptive: Here they're ashes. He's all finished. He got them on fire. 

2- categorical: He's buying them. Going to bum them. 
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41 . 

0- insufficient : It ‘ s a boy. Have to have a mother. 

1- descriptive? He's getting bigger. Boy comes after baby (before man). 

2- categoricaTT He's older than the baby (younger than the man). 
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42 . 

0- Insuffi cient: They're shaving the ball. She has the ball. She's bouncing it. 

1- descriptive: They're fighting over it. He (she) wants the ball. 

2- categorical" : He took it from her (stole It). He's selfish. She wanted the 

ball, but he took it back. 
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43 . 

0- insufficient: 

1- descriptive: 

2- categorical? 



They each have one. 

They're both happy now. They're happy and they each have one. 
She s happy cuz' he shared. She's mad cuz she wanted the other. 
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• 44. 

0- insufficient : They all fly. It's a plane too. 

1- descriptive: This came first, then that, now this. 

2- categorical : It comes later than that. It's newer than that. Goes faster 

than that. 
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45. / 

0- insufficient : She's shopping for food. She's putting food on the table. 

1- descripti ve: She doesn't have any food, then she buys some, then she cooks, 

then the?/ eat. 

2- categorical : Have to buy food before you cook it. She needs food to cook (eat). 
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48. 

0- insufficient: It has a lot of lines. . It * s fuller. 

1- descri ptivfe : The middle is smaller on the bottom ones. Top have 3 parts, 

bottom have four. 

2- categorical: The bottom ones have more lines (parts). 



49. 

0- insufficient: It's plus. That goes with this. 

1- descriptive : One equals 3 plus 2. 

2- categorical : You have to subtract. It's subtraction. 
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50 . 

0- insufficient : 

1- description: 
2 “ categorical : 



Bottom ones are used. It‘s all qone 
drank that one. 

The bottom ones are part of the top. 
The bottom ones have half as much. 



He ate that one and 




51. 

0- insufficient : It's close. It turned around. It's going back. 

1- descriptive : It's more near. It's still coming. 

2- abstract: The bottom ones are closer. 
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52 . 

0- insufficient : That one's there, so this one should be here. 

1- descriptive : The bottom ones are moving. 

2- categorical : The bottom ones are leaving (starting off, going away). 
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53 . 

0- insufficient : They both go in water. 

1- descriptive : They have motors * * Bottom ones make noise. 

2- categorical : Bottom ones are faster (motor driven). 
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54 . 

0- insufficient : It's a triangle. It's big. 

1- descriptive : little and big ones together. Bottom ones are big. 

It's the other shape. It's bigger. 

Little triangle goes with big circle, so little circle 
goes with big triangle. It changes size and shape. 



2- abstract: 



55 . 

You eat both of those. They're both wet. 
That's hot and that's cold, so that's full and 
that's empty. 

The bottom ones are opposite. 
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0- insufficient : 

1- descriptive : 

2- abstract: 
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56 . 

0“ insufficient : cuz' she's old. It's a qirl. Both older. 

1- descriptive : They're looking that way (direction). She's older 

than the baby. It's got to be a little girl. 

2- abstract : Girl goes with old lady (grandmother). Bottom ones 

are younger. 
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57 . 

0- insufficient : She's a girl. They are girls. 

1- description : Big one goes with little one. Bottom ones are younger. 

2- abstract : She is younger. Daughter goes with mother. 




58. 

0- insufficient: Finger goes in a glove. Both fingers. 

1- descripti ve : A hand has fingers. Fingers go with hands. 

2- categorical : A finger is part of a hand. 



59 . 

0- i nsufficient : He fights the fire. He climbs the ladder. 

1- descriptive : The fireman (holds, fights with, carries) a hose. 

2- categorical" : It's the fireman's tool (weapon). 
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59 . 

0- insufficient : It's a foot. You wear a sock in a shoe. 

1- descriptive : Foot goes with shoe. 

2- categorical : shoe goes on foot. You wear shoe on your foot. 



